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(54) Using a mobile device to compose an electronic message that includes audio content 



(57) Methods, systems, and computer program 
products for using a mobile device to compose an elec- 
tronic message by adding audio content to the mes- 
sage. Mobile devices include any type of portable or 
hand-held computing device, such as wireless tele- 
phones, personal digital assistants, and the like. After 
selecting the option to add audio content, the user 
speaks into the mobile device's audio input. The mobile 



device diverts the resulting audio stream into a tempo- 
rary storage as the user speaks. To provide visual feed- 
back, a progress indicator shows the user the amount 
of audio content stored compared to the amount that 
may be stored. An indicator shows that a message in- 
cludes audio content as well as the size of the included 
audio content. No particular format or type is required 
for the audio content or electronic message. 
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Description 

1. Related Applications 

[0001] This application claims the benefit of U.S. Pro- 
visional Application No. 60/239,367, entitled, "INSERT 
VOICE ATTACHMENT IN A MAIL MESSAGE ON A MO- 
BILE DEVICE," filed October 1 1 , 2000, which is hereby 
incorporated by reference. 

2. The Field of the Invention 

[0002] The present invention relates to electronic 
messages and mobile devices. More specifically, the 
present invention relates to methods, systems, and 
computer program products for using a mobile device 
to compose an electronic message that includes audio 
content. 

3. Background and Related Art 

[0003] Over the past few years, email and other types 
of electronic messaging have become an almost indis- 
pensable form of communication. While, at least initially, 
email access and electronic messaging capabilities 
identified an organization or individual operating at the 
technological forefront, today the converse is true. No 
email access or electronic messaging suggests that an 
organization or individual is technologically backward. 
With the increasing importance of email in particular, ac- 
cess limited to home or office is proving to be inade- 
quate. For example, many insist on the ability to access 
email remotely, such as through the World Wide Web 
("Web") or some other technology. However, access 
generally requires the use of a desktop computer, a lap- 
top, or personal digital assistant ("PDA"). Although 
many of these devices have decreased in bulk from ear- 
lier forms, they remain relatively large computing devic- 
es that may not be convenient for carrying on one's per- 
son at all times. 

[0004] Like desktops, laptops, and PDAs, mobile tel- 
ephones have been reduced significantly in size and 
weight. Ever shrinking form factors and airtime costs 
have made mobile telephones extremely popular in to- 
day's society. In spite of their small size and conven- 
ience, however, mobile telephones typically have not 
been used for remote email access. Among other rea- 
sons, the lack of complete integration with email sys- 
tems may be attributed to the tedious nature of entering 
text on a telephone keypad during the composition of 
an email message. Figure 2 shows a typically keypad 
220 for a mobile telephone 200. With three or four letters 
assigned to eight keys, it can be a significant chore to 
select individual letters and organize them into words. 
For example, multiple key presses may be required for 
selecting a single letter. In one system, the number of 
times a key is pressed corresponds to the position of the 
letters located on that key. Pressing "44 33 555 555 666" 



types the word "hello" - where spaces between numbers 
indicate relatively longer pauses between key presses. 
The number of key presses and need for somewhat pre- 
cise timing can be quite cumbersome. Other text entry 
5 technology is available, but as a rule text entry on a mo- 
bile telephone keypad is far from ideal for the typical us- 
er. 

SUMMARY OF THE INVENTION 

10 

[0005] The present invention allows a user to com- 
pose an email or other electronic message by adding 
audio content to the message. The user selects an op- 
tion for adding the audio content and then speaks into 
15 a mobile device's audio input. As used in this applica- 
tion, the term "mobile device" should be interpreted 
broadly to encompass any type of portable and/or hand- 
held computing device, including wireless telephones, 
personal digital assistants, etc. The mobile device di- 
20 verts the audio stream into a temporary storage, such 
as a file, as it is spoken. To provide the user with visual 
feedback, a progress indicator shows the amount of au- 
dio content stored in relationship to the maximum 
amount that may be stored for a single message, based 
25 on available memory. After being added, a text indicator 
shows that the message includes audio content as well 
as the size of the recording. No particular format is re- 
quired for the audio content, but a WAV file format is the 
default. In an email message context, the audio content 
30 is added to the message as a standard Multipurpose In- 
ternet Mail Extensions ("MIME") attachment, but the in- 
vention does not exclude other techniques. Audio con- 
tent may be added to a new email, a reply to an email, 
in forwarding an email, etc. 
35 [0006] One benefit to a message, as opposed to live 
telephone communication and voice mail, is that a mes- 
sage allows the intended recipient to act on the mes- 
sage at the recipient's convenience. For example, a us- 
er may need to provide a recipient with certain informa- 
40 tion. Overatelephonecommunication, the user calls the 
recipient and requires immediate attention. In contrast, 
sending an electronic message, such as an email, does 
not interrupt the recipient's current activities and allows 
for action at the recipient's convenience. This feature is 
45 particularly useful where time zone differences would 
otherwise prohibit calling the recipient. While it may not 
be proper to call the recipient at 2AM, sending a mes- 
sage at 2AM does not impose any burden on the recip- 
ient whatsoever. A similar option may not exist in the 
50 telephone communication context, because to leave a 
voice mail, the user must first call the recipient's phone 
number. Although less imposing, similar issues exist 
during normal business hours when the user needs to 
provide the recipient information, but does not want to 
55 interrupt the recipient. 

[0007] Additional features and advantages of the in- 
vention will be set forth in the description which follows, 
and in part will be obvious from the description, or may 
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be learned by the practice of the invention. The features 
and advantages of the invention may be realized and 
obtained by means of the instruments and combinations 
particularly pointed out in the appended claims. These 
and other features of the present invention will become 
more fully apparent from the following description and 
appended claims, or may be learned by the practice of 
the invention as set forth hereinafter. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0008] In order to describe the manner in which the 
above-recited and other advantages and features of the 
invention can be obtained, a more particular description 
of the invention briefly described above will be rendered 
by reference to specific embodiments thereof which are 
illustrated in the appended drawings. Understanding 
that these drawings depict only typical embodiments of 
the invention and are not therefore to be considered as 
limiting its scope, the invention will be described and ex- 
plained with additional specificity and detail through the 
use of the accompanying drawings in which: 

Figure 1 illustrates an exemplary system that pro- 
vides a suitable operating environment for the 
present invention; 

Figure 2 is shows several input systems for mobile 
telephones; 

Figures 3A-3D illustrate a user interface that oper- 
ates in accordance with the present invention; and 
Figure 4 shows an exemplary method for using a 
mobile device to compose an electronic message 
that includes audio content. 

DETAILED DESCRIPTION OF THE INVENTION 

[0009] The present invention extends to methods, 
systems, and computer program products for using a 
mobile device to compose an electronic message that 
includes audio content. Those skilled in the art will ap- 
preciate that the invention may be practiced in network 
computing environments with many types of computer 
system configurations, including personal computers, 
mobile/hand-held devices, such as personal digital as- 
sistants ("PDAs") and wireless telephones, multi-proc- 
essor systems, microprocessor-based or programma- 
ble consumer electronics, network PCs, minicomputers, 
mainframe computers, and the like. The invention may 
also be practiced in distributed computing environments 
where tasks are performed by local and remote process- 
ing devices that are linked (either by hardwired links, 
wireless links, or by a combination of hardwired or wire- 
less links) through a communications network. In a dis- 
tributed computing environment, program modules may 
be located in both local and remote memory storage de- 
vices. The embodiments of the present invention may 
comprise a special purpose or general purpose compu- 
ter including various computer hardware, as discussed 



in greater detail below. 

[0010] Embodiments within the scope of the present 
invention also include computer-readable media for car- 
rying or having computer-executable instructions or da- 

5 ta structures stored thereon. Such computer-readable 
media can be any available media that may be accessed 
by a general purpose or special purpose computer. By 
way of example, and not limitation, such computer-read- 
able media may comprise RAM, ROM, EEPROM, flash 

10 memory, CD-ROM or other optical disk storage, mag- 
netic disk storage or other magnetic storage devices, or 
any other medium which can be used to carry or store 
desired program code means in the form of computer- 
executable instructions or data structures and which can 

15 be accessed by a general purpose or special purpose 
computer. When information is transferred or provided 
over a network or another communications connection 
(either hardwired, wireless, or a combination of hard- 
wired or wireless) to a computer, the computer properly 

20 views the connection as a computer-readable medium. 
Thus, any such a connection is properly termed a com- 
puter-readable medium. Combinations of the above 
should also be included within the scope of computer- 
readable media. Computer-executable instructions 

25 comprise, for example, instructions and data which 
cause a general purpose computer, special purpose 
computer, or special purpose processing device to per- 
form a certain function or group of functions. 
[0011] Figure 1 and the following discussion are in- 

30 tended to provide a brief, general description of a suit- 
able computing environment in which the invention may 
be implemented. Although not required, the invention 
may be described in the general context of computer- 
executable instructions, such as program modules, be- 

35 ing executed by computers in network environments. 
Generally, program modules include routines, pro- 
grams, objects, components, data structures, etc. that 
perform particular tasks or implement particular abstract 
data types. Computer-executable instructions, associ- 

40 ated data structures, and program modules represent 
examples of the program code means for executing 
steps of the methods disclosed herein. The particular 
sequence of such executable instructions or associated 
data structures represent examples of corresponding 

45 acts for implementing the functions described in such 
steps. 

[0012] With reference to Figure 1 , an exemplary sys- 
tem for implementing the invention comprises a general 
purpose computing device in the form of a generic com- 

50 puter 20, including a processing unit 21 , a system mem- 
ory 22, and a system bus 23 that couples various system 
components including the system memory 22 to the 
processing unit 21 . Although some components of com- 
puter 20, such as monitor 47, keyboard 40, and mouse 

55 42, may seem specific to a conventional computer, 
those of skill in the art will recognize that analogous 
components may be found in other computing devices. 
For example, wireless telephones often include an LCD 
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or plasma display area, a numeric keypad, and one or 
more navigation buttons. Therefore, any component de- 
scribed with reference to generic computer 20 should 
be interpreted broadly to encompass analogous com- 
ponents that are appropriate for and consistent with a 
particular implementation or embodiment of the present 
invention. In some implementations, a component may 
be connected only intermittently or may be missing en- 
tirely. 

[0013] The system bus 23 may be any of several 
types of bus structures including a memory bus or mem- 
ory controller, a peripheral bus, and a local bus using 
any of a variety of bus architectures. The system mem- 
ory includes read only memory (ROM) 24 and random 
access memory (RAM) 25. A basic input/output system 
(BIOS) 26, containing the basic routines that help trans- 
fer information between elements within the computer 
20, such as during start-up, may be stored in ROM 24. 
[001 4] The computer 20 may also include a magnetic 
hard disk drive 27 for reading from and writing to a mag- 
netic hard disk 39, a magnetic disk drive 28 for reading 
from or writing to a removable magnetic disk 29, and an 
optical disk drive 30 for reading from or writing to remov- 
able optical disk 31 such as a CD-ROM or other optical 
media. The magnetic hard disk drive 27, magnetic disk 
drive 28, and optical disk drive 30 are connected to the 
system bus 23 by a hard disk drive interface 32, a mag- 
netic disk drive-interface 33, and an optical drive inter- 
face 34, respectively. The drives and their associated 
computer-readable media provide nonvolatile storage 
of computer-executable instructions, data structures, 
program modules and other data for the computer 20. 
Although the exemplary environment described herein 
employs a magnetic hard disk39, a removable magnetic 
disk 29 and a removable optical disk 31 , other types of 
computer readable media for storing data can be used, 
including magnetic cassettes, flash memory cards, dig- 
ital video disks, Bernoulli cartridges, RAMs, ROMs, and 
the like. Note that decreasing form factors are making it 
practical to use at least some of the foregoing compo- 
nents with mobile devices. Furthermore, it is anticipated 
that future technological advances with respect to size, 
power consumption, and the like, will lead to an in- 
creased selection of storage options. 
[0015] Program code means comprising one or more 
program modules may be stored on the hard disk 39, 
magnetic disk 29, optical disk 31 , ROM 24 or RAM 25, 
including an operating system 35, one or more applica- 
tion programs 36, other program modules 37, and pro- 
gram data 38. A user may enter commands and infor- 
mation into the computer 20 through keyboard 40, point- 
ing device 42, or other input devices (not shown), such 
as a numeric keypad, directional buttons, pressure-sen- 
sitive software keyboard, microphone, joy stick, game 
pad, satellite dish, scanner, or the like. These and other 
input devices are often connected to the processing unit 
21 through a serial port interface 46 coupled to system 
bus 23. Alternatively, the input devices may be connect- 



ed by other interfaces, such as a parallel port, a game 
port or a universal serial bus (USB). A monitor 47 or an- 
other display device, such as an LCD or gas plasma dis- 
play, is also connected to system bus 23 via an interface, 
5 such as video adapter 48. In addition to the monitor, per- 
sonal computers typically include other peripheral out- 
put devices (not shown), such as speakers and printers. 
[0016] The computer 20 may operate in a networked 
environment using logical connections to one or more 
remote computers, such as remote computers 49a and 
49b. Remote computers 49a and 49b may each be an- 
other personal computer, a server, a router, a network 
PC, a peer device or other common network node, and 
typically include many or all of the elements described 
above relative to the computer 20, although only mem- 
ory storage devices 50a and 50b and their associated 
application programs 36a and 36b have been illustrated 
in Figure 1. The logical connections depicted in Figure 
1 include a local area network (LAN) 51 and a wide area 
network (WAN) 52 that are presented here by way of 
example and not limitation. Such networking environ- 
ments are commonplace in office-wide or enterprise- 
wide computer networks, intranets and the Internet. 
[0017] When used in a LAN networking environment, 
the computer 20 is connected to the local network 51 
through a network interface or adapter 53. When used 
in a WAN networking environment, the computer 20 may 
include a modem 54, a wireless link, or other means for 
establishing communications over the wide area net- 
work 52, such as the Internet. The modem 54, which 
may be internal or external, is connected to the system 
bus 23 via the serial port interface 46. In a networked 
environment, program modules depicted relative to the 
computer 20, or portions thereof, may be stored in the 
remote memory storage device. It will be appreciated 
that the network connections shown are exemplary and 
other means of establishing communications over wide 
area network 52 may be used. 

[0018] Figure 2 shows several input systems for mo- 
bile telephones. Four-direction and action button 21 0 al- 
lows for interaction with a user interface, such as navi- 
gating between and/or executing various user interface 
input controls that will be described with reference to 
Figures 3A-3D. A user may enter numbers and text with 
keypad 220. However, as suggested above, text entry 
through a numeric keypad may be a cumbersome task. 
Audio input 230 is the mobile telephone's mouthpiece. 
[0019] The present invention is described in the con- 
text of composing the reply to an electronic mail mes- 
sage, as illustrated in Figures 3A-3D. It should be noted 
that the present invention is not limited to any particular 
type of electronic message. Electronic mail is simply a 
familiar type of electronic message that helps to clarify 
the principles of the present invention. Furthermore, for 
electronic mail messages, the present invention may be 
used in composing a new message, in replying to or for- 
warding a received message, etc. 
[0020] Turning first then to Figure 3A, title 312 indi- 
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cates the user is composing a reply message. Recipi- 
ents 322 identifies those who will receive the electronic 
message, and subject 324 briefly describes the mes- 
sage's topic or content. Within the body of the reply mes- 
sage, reply text 352 identifies text added as part of the 
reply and received message text 354 identifies text from 
the message to which the reply is directed. Message text 
354 often is indented to set it off from reply text 352. 
Send 372 sends the reply as composed, and a user may 
access additional message options through menu 374. 
Those of skill in the art will recognize that composing a 
reply requires minimal if any text entry. All information, 
with the exception of reply text 352 may be generated 
from the received message. If the user adds audio data 
to the reply, however, reply text 352 may be completely 
unnecessary. 

[0021] Selecting menu 374 presents the user with 
menu items 380, as shown in Figure 3B. Menu 374 is 
highlighted upon selection to provide the user with visual 
feedback that menu items 380 corresponds to the acti- 
vation of menu 374. Add To: 381 allows the user to iden- 
tify additional recipients 322 for the reply. The user adds 
reply text 352 by selecting Insert Text 382. Insert Voice 
383 will be described below with reference to Figure 3C. 
Message Options 384 provides for message specific 
customizations, including message delivery options, 
such as message delivery and expiration times, tracking 
options, such a delivery and read receipts, and message 
settings, such as sensitivity and importance. To send the 
reply at a future time, the user selects Postpone Mes- 
sage 385. In contrast, selecting Send Message 386 
sends the message immediately. The user may termi- 
nate composing the reply message by selecting Cancel 
Compose 387. 

[0022] The selection of Insert Voice 383 from menu 
items 380 allows for the addition of audio content to the 
reply message, as shown in Figure 3C. After selecting 
Insert Voice 383 (Figure 3B), the audio content stream 
received at the mobile telephone's mouthpiece 230 (Fig- 
ure 2) is diverted to temporary storage. The temporary 
storage for the recording illustrated in Figure 3C is a 
temporary file. "Recording" in title 31 4 indicates to a user 
that the screen is for recording audio content. A 
progress indicator 362 shows the amount of audio con- 
tent stored in relation to a maximum amount that may 
be stored. The present invention does not necessarily 
limit the amount of audio content that may be stored and 
attached to an electronic message. However, mobile de- 
vices generally have some limitation on the amount of 
available storage and communication bandwidth. As a 
result, practical considerations may dictate that audio 
content be limited in duration. Selecting Stop 376 ends 
storage of the audio content stream and adds the tem- 
porary file to the reply message. As an alternative to se- 
lecting Insert Voice 383 from menu items 380 (Figure 
3B), a record button on a mobile telephone also may 
provide a command to add audio content to the reply 
message. Depending on the implementation, either re- 



leasing the record button or pressing the record button 
a second time has an effect similar to selecting Stop 
376. 

[0023] Figure 3D depicts a reply message with attach 
5 audio content. Figure 3D is similar to Figure 3A, includ- 
ing recipients 322, subject 324, reply text 352, message 
text 354, Send 372 and Menu 374, with the addition of 
indicator 326 showing that the reply includes a voice re- 
cording of 1 5 kilobytes. Storage of audio content gener- 
ally requires significantly more memory than the storage 
of text. Therefore, file formats for audio content usually 
implement some form of data compression to balance 
an appropriate level of audio quality with reasonable 
storage space. The WAV file format represents one im- 
plementation of this balancing. Because the WAV file 
format is frequently used in many computers it may be 
selected as a default. For electronic mail messages, the 
audio content may be included as a Multipurpose Inter- 
net Mail Extensions ("MIME") attachment. MIME sup- 
ports a number of predefined file types and provides a 
standard mechanism for defining others. The present in- 
vention, however, does not necessarily require any par- 
ticular file format, compression technology, or standard 
for adding audio content to a message. 
[0024] Figure 4 illustrates an exemplary method for 
using a mobile device, such as a wireless telephone or 
PDA, to compose an electronic message that includes 
audio content. A step for initiating (410) the creation of 
an electronic message may include an act of receiving 
(412) a specific electronic message. For example, the 
electronic message being created may be a reply to an 
electronic message received earlier. The act of receiv- 
ing a command to begin composing (414) the electronic 
message and the act of receiving a command to add 
audio content (41 6) to an electronic message may also 
be included within the step for initiating (410) creation 
of the electronic message. Commands may be received 
from selection of a user interface menu item as illustrat- 
ed in Figures 3B and 3C, from a record button, etc. 
[0025] A step for capturing (420) audio content from 
an audio content stream may begin with the act of di- 
verting (422) the audio content stream being received 
at an audio input, such as wireless telephone mouth- 
piece 230 (Figure 2), to a temporary storage. The tem- 
porary storage may include a temporary file stored in 
volatile memory, such as RAM, or stored in non-volatile 
memory, such as optical and/or magnetic media. An act 
of displaying (424) a progress indicator may accompany 
the act of storing (426) the audio content stream in tem- 
porary storage. The progress indicator shows the cur- 
rent amount of storage used in storing the audio content 
stream compared to a predetermined maximum amount 
of storage that may be added to a single message, al- 
though other types of progress indicators are not exclud- 
ed by the present invention. The acts of displaying (424) 
a progress indicator and storing (426) the audio content 
stream may be included in the step for capturing (420) 
audio content. 
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[0026] The step for adding (430) audio content to an 
electronic message may include the following acts. An 
act of formatting (432) the audio content is based how 
the audio content will be added to the electronic mes- 
sage. For example, audio content added as an attach- 
ment to an electronic mail message is formatted accord- 
ing to the file type of the attachment. In many circum- 
stances, a WAV file format may be selected because it 
is a format recognize by many computing systems. An 
act of compressing (434) the audio content may accom- 
pany the act of formatting (432), consistent with a par- 
ticular file format, or may represent an entirely distinct 
operation. An act of attaching (436) the audio content to 
the electronic message is based on the facilities allowed 
by a particular electronic message. For electronic email 
messages, the audio content may be included as a 
MIME attachment. The acts of displaying an attached 
audio content indicator (438) and displaying audio con- 
tent size (442) provide the user some feedback that au- 
dio content has been added to the electronic message 
as desired. 

[0027] The present invention may be embodied in oth- 
er specific forms without departing from its spirit or es- 
sential characteristics. The described embodiments are 
to be considered in all respects only as illustrative and 
not restrictive. The scope of the invention is, therefore, 
indicated by the appended claims rather than by the 
foregoing description. All changes which come within 
the meaning and range of equivalency of the claims are 
to be embraced within their scope. 



Claims 

1 . In a computerized system that includes one or more 
mobile devices and an electronic message server 
supporting wireless communication, wherein at 
least some of the mobile devices have an input sys- 
tem that is optimized for numeric input rather than 
text input, and wherein at least some of the mobile 
devices are capable of sending and receiving elec- 
tronic messages, a method of composing an elec- 
tronic message using a mobile device, the method 
comprising the acts of: 

receiving a command to begin composing an 
electronic message; 

receiving a command to add audio content to 
the electronic message; 
diverting to a temporary storage, an audio con- 
tent stream received at an audio input; 
storing the audio content stream in a format that 
is compatible with adding audio content to the 
electronic message; and 
attaching the formatted audio content to the 
electronic message. 

2. A method as recited in claim 1 , wherein the mobile 



device comprises a phone and the temporary stor- 
age comprises a temporary data file, and wherein 
the audio content stream received at the audio input 
is generated by a user speaking into the phone's 
5 mouthpiece. 

3. A method as recited in claim 1 , wherein the elec- 
tronic message comprises an electronic mail mes- 
sage, and wherein the formatted audio content is 

10 attached as an electronic mail attachment. 

4. A method as recited in claim 3, wherein the elec- 
tronic mail message is composed in either replying 
to or forwarding a specific electronic mail message, 

15 the method further comprising the act of receiving 
the specific electronic mail message. 

5. A method as recited in claim 1, wherein the total 
amount of audio content that may be stored in tem- 

20 porary storage is limited to a predetermined maxi- 
mum, the method further comprising the act of dis- 
playing a progress indicator to show a current 
amount of temporary storage used in storing the da- 
ta stream compared to the predetermined maxi- 

25 mum. 

6. A method as recited in claim 1 , wherein the format 
used to store the audio content stream allows for 
data compression, the method further comprising 

30 the act of compressing the audio content stream in 
accordance with the storage format. 

7. A method as recited in claim 6, wherein the storage 
format is a WAV file format. 

35 

8. A method as recited in claim 1, wherein receiving 
the command to add audio content to the electronic 
message is based on either the selection of a user 
interface menu item to add audio content to the 

40 electronic message or the press of a record button. 

9. A method as recited in claim 1 , further comprising 
the acts of: 

45 displaying an indicator that audio content has 

been attached to the electronic message; and 
displaying the size of the attached audio con- 
tent. 

50 1 o. In a computerized system that includes one or more 
mobile devices and an electronic message server 
supporting wireless communication, wherein at 
least some of the mobile devices have an input sys- 
tem that is optimized for numeric input rather than 
55 text input, and wherein at least some of the mobile 
devices are capable of sending and receiving elec- 
tronic messages, a method of composing an elec- 
tronic mail message using a wireless telephone, the 
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method comprising the acts of: 

receiving a command to begin composing an 
electronic mail message; 
receiving a command to add audio content to 
the electronic mail message; 
diverting to a temporary storage, an audio con- 
tent stream received at a wireless telephone 
voice input; 

storing the audio content stream in a format that 
is compatible with adding audio content to the 
electronic mail message; and 
attaching the formatted audio content to the 
electronic mail message. 

11. A method as recited in claim 10, wherein the elec- 
tronic mail message is composed in either replying 
to or forwarding a specific electronic mail message, 
the method further comprising the act of receiving 
the specific electronic mail message. 

12. A method as recited in claim 10, wherein attaching 
the formatted audio content to the electronic mail 
message complies with a Multipurpose Internet 
Mail Extensions specification. 

13. A method as recited in claim 1 0, wherein the format 
used to store the data stream allows for data com- 
pression, the method further comprising the act of 
compressing the data stream in accordance with 
the storage format. 

14. A method as recited in claim 10, wherein the total 
amount of audio content that may be stored in tem- 
porary storage is limited to a predetermined maxi- 
mum, the method further comprising the act of dis- 
playing a progress indicator to show a current 
amount of temporary storage used in storing the da- 
ta stream compared to the predetermined maxi- 
mum. 

15. A method as recited in claim 10, wherein receiving 
the command to add audio content to the electronic 
mail message is based on either the selection of a 
user interface menu item to add audio content to 
the electronic mail message or the press of a record 
button, the method further comprising the acts of: 

displaying an indicator that audio content has 
been attached to the electronic mail message; 
and 

displaying the size of the attached audio con- 
tent. 

16. In a computerized system that includes one or more 
mobile devices and an electronic message server 
supporting wireless communication, wherein at 
least some of the mobile devices have an input sys- 



tem that is optimized for numeric input rather than 
text input, and wherein at least some of the mobile 
devices are capable of sending and receiving elec- 
tronic messages, a method of composing an elec- 
5 tronic message using a mobile device, the method 

comprising steps for: 

initiating the creation of an electronic message, 
the electronic message to include audio con- 
10 tent; 

capturing audio content from an audio content 
stream being received at an audio input, where- 
in the audio content stream is generated by a 
user speaking into the audio input; 
15 adding the audio content to the electronic mes- 

sage in a format that is compatible with the elec- 
tronic message. 

17. A method as recited in claim 1 6, wherein the mobile 
20 device comprises a telephone, and wherein the au- 
dio stream is generated by a user speaking into the 
telephone's mouthpiece. 

18. A method as recited in claim 16, wherein the elec- 
ts tronic message comprises an electronic mail mes- 
sage, and wherein the step for adding the audio 
content to the electronic message comprises the 
acts of: 

30 formatting the captured audio content stream 

to be compatible with the electronic mail mes- 
sage; and 

attaching the formatted audio content to the 
electronic mail message. 

35 

19. A method as recited in claim 18, wherein the elec- 
tronic mail message is composed in either replying 
to or forwarding a specific electronic mail message, 
and wherein the step for initiating the creation of the 

40 electronic mail message includes the act of receiv- 
ing the specific electronic mail message. 

20. A method as recited in claim 16, wherein the step 
for capturing audio content from the audio content 

45 stream comprises the acts of: 

diverting the audio content stream to a tempo- 
rary storage; and 

storing the audio content stream in the tempo- 
50 rary storage. 

21. A method as recited in claim 20, wherein the tem- 
porary storage comprises a temporary data file that 
is limited to a predetermined maximum of the total 

55 amount of audio content that may be stored, and 
wherein the step for capturing audio content from 
the audio content stream further comprises the act 
of displaying a progress indicator to show a current 
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amount of temporary storage used in storing the da- 
ta stream compared to the predetermined maxi- 
mum. 

22. A method as recited in claim 1 6, wherein the format 
used to store the data stream allows for data com- 
pression, and wherein the step for adding the audio 
content to the electronic message comprises the 
act of compressing the audio content stream in ac- 
cordance with the storage format. 

23. A method as recited in claim 16, wherein the step 
for initiating the creation of an electronic message 
comprises the acts of: 

receiving a command to begin composing an 
electronic message; and 
receiving a command to add audio content to 
the electronic message, wherein the act of re- 
ceiving the command to add audio content to 
the electronic message is based on either the 
selection of a user interface menu item to add 
audio content to the electronic message or the 
press of a record button. 

24. A method as recited in claim 16, wherein the step 
for adding the audio content to the electronic mes- 
sage comprises the acts of: 

displaying an indicator that audio content has 
been added to the electronic message; and 
displaying the size of the added audio content. 

25. In a computerized system that includes one or more 
mobile devices and an electronic message server 
supporting wireless communication, wherein at 
least some of the mobile devices have an input sys- 
tem that is optimized for numeric input rather than 
text input, and wherein at least some of the mobile 
devices are capable of sending and receiving elec- 
tronic messages, a computer program product for 
implementing a method of composing an electronic 
message using a mobile device, comprising: 

a computer readable medium for carrying ma- 
chine-executable instructions for implementing 
the method; and 

wherein said method is comprised of machine- 
executable instructions for a mobile device per- 
forming the acts of: 

receiving a command to begin composing 

an electronic message; 

receiving a command to add audio content 

to the electronic message; 

diverting to a temporary storage, an audio 

content stream received at an audio input; 

storing the audio content stream in aformat 



that is compatible with adding audio con- 
tent to the electronic message; and 
attaching the formatted audio content to 
the electronic message. 

5 

26. A computer program product as recited in claim 25, 
wherein the mobile device comprises a phone and 
the temporary storage comprises a temporary data 
file, and wherein the audio content stream received 

10 at the audio input is generated by a user speaking 
into the phone's mouthpiece. 

27. A computer program product as recited in claim 25, 
wherein the electronic message comprises an elec- 
ts tronic mail message, and wherein the formatted au- 
dio content is attached as an electronic mail attach- 
ment. 

28. A computer program product as recited in claim 27, 
20 wherein the electronic mail message is composed 

in either replying to or forwarding a specific elec- 
tronic mail message, the method further comprising 
the act of receiving the specific electronic mail mes- 
sage. 

25 

29. A computer program product as recited in claim 25, 
wherein the total amount of audio content that may 
be stored in temporary storage is limited to a pre- 
determined maximum, the method further compris- 

30 ing the act of displaying a progress indicator to show 
a current amount of temporary storage used in stor- 
ing the data stream compared to the predetermined 
maximum. 

35 30. A computer program product as recited in claim 25, 
wherein the format used to store the audio content 
stream allows for data compression, the method 
further comprising the act of compressing the audio 
content stream in accordance with the storage for- 
40 mat. 

31 . A computer program product as recited in claim 30, 
wherein the storage format is a WAV file format. 

45 32. A computer program product as recited in claim 25, 
wherein receiving the command to add audio con- 
tent to the electronic message is based on either 
the selection of a user interface menu item to add 
audio content to the electronic message or the 

50 press of a record button. 

33. A computer program product as recited in claim 25, 
the method further comprising the acts of: 

55 displaying an indicator that audio content has 

been attached to the electronic message; and 
displaying the size of the attached audio con- 
tent. 
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